Simon Willison explains how to use the mistral.rs library in Rust to run the Llama Vision model on a Mac M2 laptop. He provides a detailed example and discusses the memory usage and GPU utilization.
The author records a screen capture of their Gmail account and uses Google Gemini to extract numeric values from the video.
Datasette is introduced as a functional interactive frontend to tabulated data, either in CSV format or a database schema, catering to data journalists, museum curators, archivists, local governments, and researchers.
The author explores creating tables and inserting data into a SQLite database, then targets the database with Datasette to showcase how errors in data can be identified and corrected.
The author explores creating tables and inserting data into a SQLite database, then targets the database with Datasette to showcase how errors in data can be identified and corrected.
Simon Willison recently delivered a talk during the Mastering LLMs: A Conference For Developers & Data Scientists, which was a six-week long online event. The talk centered around Simon's LLM Python command-line utility and its plugins, emphasizing how they can be utilized to explore Large Language Models (LLMs) and perform various tasks. Last week, he discussed accessing LLMs from the command-line, sharing valuable insights and techniques with the audience.
Simon Willison shares a scraping technique called Git scraping, where data is scraped and tracked over time by committing the changes to a Git repository. He demonstrates the technique using an example of California fires data from CAL FIRE website.
Simon Willison explains an accidental prompt injection attack on RAG applications, caused by concatenating user questions with documentation fragments in a Retrieval Augmented Generation (RAG) system.
* **http.server**: Run a localhost web server on port 8000: `python -m http.server`
* **base64**: Encode/decode base64: `python -m base64 -h`
* **asyncio**: Python console with top-level `await`: `python -m asyncio`
* **tokenize**: Debug mode for Python tokenizer: `python -m tokenize cgi.py`
* **ast**: Debug mode for Python AST module: `python -m ast cgi.py`
* **json.tool**: Pretty-print JSON: `echo '{"foo": "bar"}' | python -m json.tool`
* **random**: Benchmarking suite for random number generators (fixed in Python 3.13)
* **nntplib**: Display latest articles in a newsgroup: `python -m nntplib`
* **calendar**: Show a calendar for the current year: `python -m calendar` (with options like `-t html`)
* **base64**: Encode/decode base64: `python -m base64 -h`
* **asyncio**: Python console with top-level `await`: `python -m asyncio`
* **tokenize**: Debug mode for Python tokenizer: `python -m tokenize cgi.py`
* **ast**: Debug mode for Python AST module: `python -m ast cgi.py`
* **json.tool**: Pretty-print JSON: `echo '{"foo": "bar"}' | python -m json.tool`
* **random**: Benchmarking suite for random number generators (fixed in Python 3.13)
* **nntplib**: Display latest articles in a newsgroup: `python -m nntplib`
* **calendar**: Show a calendar for the current year: `python -m calendar` (with options like `-t html`)
Mixtral 8x7B:
Use llm-llama-cpp plugin.
Download a GGUF file for Mixtral 8X7B Instruct v0.1.
Run the model using llm -m gguf with the downloaded file.
Use llm-llama-cpp plugin.
Download a GGUF file for Mixtral 8X7B Instruct v0.1.
Run the model using llm -m gguf with the downloaded file.
Llamafile is the new best way to run a Large Language Model on your own computer, offering a single, self-contained file that can be used forever on almost any computer, without needing a network connection
The author created several GPTs, including a Dejargonizer that decodes technical terms, a JavaScript Code Interpreter that runs JavaScript code, a Dependency Chat that identifies project dependencies, and a fun Animal Chefs GPT that generates recipes with animal-themed stories.
